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(54) A multi-windowing technique for threshhoiding an image using local image properties 



(57) A "technique, specifically apparatus and an 
accompanying method, for accurately thresholding an 
image based on local image properties, specifically lumi- 
nance variations, and particularly such a technique that 
uses multi-windowing for providing enhanced immunrty 
to image noise and lessened boundary artifacts. Specif- 
ically, a localized intensity gradient. Gfij). is determined 
for a' pre-defined window (300) centered about each 
image pixel(ij). Localized minimum and maximum pixel 
intensity measures. L^ and I™,. respectively ^ are also 
determinedfor another, though larger, window (330) cen- 
tered about pixel(ij). Also, a localized area gradient 
measure. GS(ij). is determined as a sum of '"d'vidua 
intensity gradients lor a matrix of pixel positions (370) 
centered about pixel position (i j). Each image pixel(ij) is 
then classified as being an object pixel, i.e.. black, or a 
background pixel, i.e.. white, based upon its area gradi- 
ent GS(i j). and associated ^ and L^ measures. 
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Descripti n 

TECHNICAL FF « n OF THE INVENTION 

The invention relates to a technique, specifically apparatus and an accompanying method, for accurately thresrv 
olding an image based on local image properties, specifically luminance variations, and particularly one that uses multi- 
windowing for providing enhanced immunity to image noise and lessened boundary artifacts. 

RAP.KnROlJND ART 

With digital image processing and digital communication becoming increasingly prevalent today, increasing amounts 
of printed or other textual documents are being scanned for subsequent computerized processing of one form or another 
and/or digital transmission. This processing may involve, for example, optical character recognition, for converting printed 
characters, whether machine printed or handwritten, from scanned bit-mapped form into an appropriate character set, 
such as ASCII, the latter being more suitable for use with word processing and similar computerized document-process- 

Scanning a gray-scale document typically yields a multi-bit. typically eight-bit. value for each pixel in the scanned 
document. The value represents the luminance, in terms of a 256-level gray scale, of a pixel at a corresponding point 
in the document These pixels are generated, depending upon the resolution ol the scanner, frequently at resolutions 
of 200-400 pixels/inch (approximately 80-1 60 pixels/cm), though with highly detailed images at upwards of 1200 or more 
pixels/inch (approximately 470 pixels/cm). Consequently, a scanned 8 1 12 by 1 1 inch (approximately 22 by 28 cm) image 
will contain a considerable amount of gray-scale data. Inasmuch scanned text generally presents a written or printed 
characters of some sort against a contrasting colored background, typically white or black print against a white or light 
colored background, or vice versa, the exact luminance value at any one pixel in the text is not as important as whether 
that pixel is either part of a character or the background. Therefore, scanned textual images, or scanned textual portions 
of larger images containing both text and graphics, can be efficiently represented by single-bit pixels in which each pixel 
in a scanned image is sirrply set to. e.g.. a "one" if that pixel in the original image is part of a character or part of 
foreground information, or to. e.g.. a "zero" if that pixel in the original image is part of the image background. To easily 
distinguish the different types of scanned images, a gray-level image is defined as one having multi-bit (hence multi- 
value) pixels whereas a binary (or bi-level) image is formed of single-bit pixels. Furthermore, since binary images gen- t 
erate considerably less data for a given textual image, such as, e.g.. one-eighth, as much as for an eight-bit gray-scale 
rendering of the same image, binary images are more efficient over corresponding gray-scale images and thus preferred 
for storage and communication of textual images. Binary images are also preferred because of their easy compressibility 
using standard compression techniques, e.g.. CCITT Groups 3 or 4 compression standards. 

Gray-scale images are converted to binary images through a so-called thresholding process. In essence/each murti- 
bit pixel value in a gray-scale scanned image is compared to a pre-defined threshold value, which may be fixed, variable 
or even adaptively variable, to yield a single corresponding output bit. If the murti-bit pixel value equals or exceeds the 
threshold value for that particular pixel, the resultant single-bit output pixel is set to a "one"; otherwise H the threshold is 
greater than the multi-bit pixel, then the resultant single-bit output pixel remains at "zero". In this manner, thresholding 
extracts those pixels, such as those which form characters, or other desired objects, from the background in a scanned 
gray-scale image, with the pixels that form each character, or object, being one value, typically that for black, and the 
pixels for the background all being another value, typically that for white. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the image as simply an "object". 

Ideally, the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
scanned image and maps those pixels to a common single-bit value, such as, e.g.. "one" for black. In practice, noise, 
background shading, lighting non-unrformities in a scanning process and other such phenomena, preclude the use of a 
single fixed threshold for an entire image. In that regard, if the threshold is too low, the resulting image may contain an 
excessive amount of noise in certain, if not all regions; or, if too high, insufficient image detail, again in certain, if not all. 
regions - thereby complicating the subsequent processing of this image. Given this, the art recognizes that a preferred 
approach would be to select a different threshold value that is appropriate to each and every pixel in the scanned image. 
In doing so the proper threshold value is determined based upon local properties of the image, i.e.. certain image 
characteristics that occur in a localized image region for that pixel. Hence, the threshold would vary across the image, 
possibly even adapt to changing localized image conditions. 

In general, a common methodology for variable thresholding relies on measuring localized image characteristics, 
such as local intensity contrast (or gradient), local averaged intensity and/or local variance, in a local window centered 
about a pixel of interest and then using these measures to classify image pixels into either object pixels, black, or back- 
ground pixels, white. Here, too, reality diverges from the ideal inasmuch this methodology is complicated, and often 
frustrated by a need to extract various objects in a wide range of documents but with minimal user intervention, such 
as for purposes of initialization and object identification, and while still yielding a clean background in the thresholded 
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■ „ m rea irtv these objects may include, e.g., dim. broken objects; and objects that presents relatively low contrast. 

,mage. In reality. mese °W backQround - and gray objects embedded in a black background. 

T W rt l e ie °sTaten of fixed thresholding to provide adequafe performance with actual 

NeV6 u L ^ \°n^iSd ^bv ^acr n a several variable thresholding approaches that attempt to provide satsfactory 
images, the art has Pasted by ej dra wbacks that, in practice, tend to limHtheir utility, 

performance. However all these drf1efent locall2ed image properties, are taught in M. Kamel * 

Various approaches J images from Grayscale Document Images". r.VGIP- Graphical Models and 
a... "Extraction of BW Wj* ^« ,m ^^7. Here, a -logical level" approach is based on comparing a 
Image Processing, Vol. 55 ^^a 3^ May 1 ^ 3 ' ^Jf . nois } Wltn four local avera ges in neighborhoods 

gray level of a given pixel or its smoothed gray le ™W™ 9 , , f th jven ixel is sufficiently below 

entered abo* ^ - relies 

all four local averages then the given p background image and a character/graphics image. First, most of 

on considering every pixel in an .mage as a sumo a oa g y 1unc ,ioning to remove "particle- noise. The 

the background pixels are ^^'XSISw *« passing through each given pixel with slopes 
liner is applied to four PJ^uence M«n ^ ^cter/graphics pixels which are black and 
of 0. n/4. „* and 3«M_ The bin y 0 fe by detecling bacK 

background p.xels ^J^2lJ!^5S arc then for every possible character/graphics pixel, the gray level 
ground pixels us.ng a ^T d ^^^^^l ^tinTSuVbacksS pixels. Lastly, a gray-scale charader/graph- 
0< tm SSSSX \SK^KSSS5d image fromthe original sinned image w* resulting 
.cs image is obtained by suu » bj character/graphics image. Though the global threshold 

differences then , beuig g^^^S^J^ threshold and a varying background value essentially 
value .tseH ,s ^^r^J*^ 8 ^'^ fjr£t blushi ^ ^ approaches would appear to be somewhat immune 
JS^^^^^^P^ ^ highly sensitive to noise and often results in a noisy bac*ground when 

extracting dim and/or broken <^£"£?^pA 4 « 670 (issued to R.R.A. Morton et al on September 
Anclher appr^. as desc..^ 

19. 1989and ^^^^f^^'^ value and a feedback signal. Here, whenever a transition 
value being *^«*£^^^Z£»Z igna. is momentarily varied in a pre-defined pattern to momentary 

m^^ 

r^rnt^ 

ties in detecting low contrast objects Stoffel et al on August 28. 1984). 

A further approach is described l,n Unrted ^^"J^J^L,,^^ which is obtained on a pixel-by-pixel 
Here, adaptive '^"^^^r!Sl> This offset potential is used in conjunction 

extracting low contrast objects Jn_ « specHically apparatus and an accompanying method, for accu- 

Theretore. a need ex.sts in the art tor a ^ n ^ e ^^^ y ^ jn ^ a thres hold that varies based on local 
rately and re.iabiy thieshc JW«J^ ^^y and'educed boundary artifacts, as we,, as 
ESSSS cj£ deS^rast objects, than do conventional variable thresholding techniques. 

n.QP.i QSJ IRE ™ -^"= INVENTION 

We have substantially and advantageously overcome the deficiencies in the art through our inventive muHi-window 

thresholding technique. j: a „4 rv; i\ ic Hptermined for each pixel (i J) in an incoming 

SpecHica.ly.throughour^ 

, scanned gray-scale bit-mapped .mage. This Qradierrt « ^ e * er ^ ,nea are detected for an N ^ y . N pixe | window 

about ^"SZZZ tSJK ™ anient. GS(i.j) being a sum of indiv^ua. intensrty 

centered over the nr«ge ™Jg**^ of ^ posit i 0 n S . typically n-2-by-n-2 pixels, centered about position 
gradmnts. is ascerta^ied for a maw 'M^o j p h background pixel, i.e.. white, primarily based 

Each pixe.(i.j) is then dassj '^^^J^^^S^ and Ua„ values. These three parameters are 

determined for andev jy p. xeKijj in t ne g associated Urn and Lma» values. Once the gradient 

sCh valTarf^ windowed. aboS pixel, position (i.j). in determining Hs conespondmg area 



gradient, GS(i j). 
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Using these local measures, each image pixel(i j) is first classified as being near an edge or not. In that regard, each 
Dixel near an edge is so classified rf the local measures therefor, specifically its associated area gradient, exceeds a 
pre-defined threshold value. Qherwise. that pixel is viewed as falling within a locally flat field, i.e., of relatively constant 
qray-scale Specifically, edge pixels are classified by comparing their intensity values against average intensity values 
for local N-by-N pixel windows therefor; in contrast, pixels in flat fields are classified by comparing their intensity against 
a pre-determined intensity value. 

In particular, an image pixel(ij) located in a vicinity of an edge in the image is detected whenever the area gradient, 
GS(i D for that pixel is high, particularly being larger than a predefined gradient threshold, GT. Once such a pixel is 
found each pixel on a darker side of the edge is found. This latter pixel being in the center of a local N-by-N. e.g., 7-by- 

w 7 pixel window is classified as an object pixel, i.e., black, whenever its intensity, Uc. is smaller than an average of Its 
associated L mln and L^x values. Alternatively, if the intensity of this latter pixel, exceeds the average intensity value 
of L and ul" then this particular pixel is classified as being background, i.e., white. 

Where thearea gradient, GS(i,j). for pixel(ij) is less than the gradient threshold, such as where the N-by-N window 
slides along an image region of relatively constant gray-scale, pixel(i.j) is classified by simple thresholding, i.e., thresh- 

is olding its gray-scale value against a constant predefined threshold value, IT. Here, if the gray-scale value of pixel(ij) is 
less than the threshold value IT, this pixel is classified as an object pixel, i.e.. black; otherwise, this pixel is designated 

as part of the background, i.e., white. 

To enhance image edges and by doing so further increase thresholding accuracy, the intensity values of those pixels 
near an edge are modified. For the preferred embodiment, black pixels are illustratively represented by a value of zero 
?o and white pixels by a value of "1 Specifically, for those pixels located on a darker side of an edge and having an intensity 
vaiu that exceeds the threshold value, IT, the intensity of each of these pixels is reduced to a value slightly below 
threshold IT, e g.. to a value IT-. In contrast, the intensity values for those pixels, located on a brighter side of an edge 
and having an intensity value less than threshold value IT, are increased to an intensity value slightly greater than thresh- 
old valu IT, e.g.. to value IT+. A high quality binary image can then be produced by merely thresholding the resulting 
gray-scale image against pre-defined threshold value IT. 

Advantageously, through the use of area (summed intensity) gradients, the present invention significantly reduces 
both background noise and boundary artifact generation while accurately extracting objects in a threshokJed image. The 
modified gray-scale image, when subsequently thresholded using a fixed threshold value IT. greatly enhances detection 
of low contrast objects and thus readily produces a high quality binary image. 
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RRIEF DESCR 'PT»r>N OF THE DRAWINGS 

The teachings of the present invention may be readily understood by considering the following detailed description 
in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a high-level block diagram of document imaging system 5 that embodies the teachings of our present 
invention; 

FIG. 2 depicts the correct alignment of the drawing sheets for FIGs. 2A and 2B; 

FIGs. 2A and 2B collectively depict a high-level flowchart of our inventive multi-windowing thresholding method; 

FIG. 3A depicts a 3-by-3 matrix of pixel location definitions which we use in determining, through a "Sober gradient 
operator, gradient strength for current pixel(i.j) ; 

FIG. 3B depicts a graphical representation of an N-by-N neighborhood of pixels centered about a current pixel(ij) 
in an image intensity record; 

FIG. 3C depicts a graphical representation of an (N-2)-by-(N-2) neighborhood of pixels centered about pixel position 
so (i.j) in an image intensity gradient record; 

FIG. 4 graphically depicts intensity profile 400 of an illustrative scan line of an original gray-scale image, such as 
that illustratively on document 10 shown in FIG. 1 ; 

55 FIG. 5 graphically depicts a modified intensity profile which results after thresholding intensity profile 400 shown in 
Fig! 4 according to the teachings of our present invention; 



ts 



FIG. 6 depicts a block diagram of a preferred embodiment of our present invention; 
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FIG. 7 depicts a block diagram of Sum of Gradients Circuit 620 which lorms part of circuit 600 shown in FIG. 6; and 

FIG. 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
. shown in FIG. 6. 

To facilitate understanding, identical reference numerals have been used, where possible, to denote identical ele- 
ments that are common to various f igures. 

nr>n F R OF CAR P""'* Q! EE ™ F INVENTION 

A«Pr readino the following description, those skilled in the art will quickly realize that our invention is applicable for 
After reading ttie ohov* g v accurat ely thresholding scanned documentary .mages containing line 

^^S^SS^^^^ and the upon which the ima9e ori9ina,,y appeare - F f r ••"S5S 

1 ' . I ^ co^e qra^hs maps, characters and/or line (skeletal) drawings. Nevertheless tor the purpose of simplrfying 
n 6 e SSKSSSfi "^discuss our invention in the context of use in threshing scanned character data, such 
the follow ng u^^ jH co n ectiv ely fe fer to hereinafter as "objects". 

as textual •^•J^SSEi Tnd dSussion. we define ttack and white gray-scale pixels as having eight-bit gray- 
For ^^^Sf^kSS^ consistency, we also define output binary pixels with black being "0" and 

tUSSZ that Xare pixel intensities, as would be readily apparent to those skilled in the art. reversed from those 

shown and |we| Wock diagram ol docume nt imaging system 5 that embodies the teachings of our present 

• A^sh^n system 5 is formed of gray-scale scanner 20. digital image processor 30 and "simple" ttresholding 

,nvent.on. As shown, system o «; or aK J^L various objects of interest is scanned by scanner 20 to produce multi- 
circuit 40. n operetta. ocumerrt ^^EXJISl. J ^ data is routed . via , ea ds 25. to a data input of digte. 
bit. typically •«^^™JJ~J 7^«SS««nt here, thresholds the scanned image data and generates both 
^^^^X^eZ^^cZ^^ irnage on .eads 33. The modified grayscale image, as 
a modified gray-scale image on _ o Drocessor 30 to subsequently increase thresholding accu- 

desaibed SSjS^SSTSll to an £* of ttreshoKing circuit 40 whidj- 

racy. The modrfied grayscale i .mage am i appea a Dr eKlefined fixed threshold value thereby 



racy. The modHied against a pre-defined fixed threshold value thereby 

compares binary, image produced by circuit 40 is applied. 

P T^l St? £ o^outP^ ^na^mage. Digital iLge processor 30 performs thresholding in accordance wrth our 
via leads 45. a .^ n °^ h e a r °^ ah da 4 tr J ughp uts required tor processing bit-mapped images, processor 30 is preter- 
present invention. To handle data ™°WP" ^ our inventive circuit 600 shown in FIG. 6 and discussed in 
^Z^ ^ZtX ^sXc^ rbe^rSmented through one or more genera, purpose microprocessors. 
^ IssSte^Te^rTaL supporting circuitry and suitably programmed to implement ourrxesent.nvent.onir, soft- 
wTe ^SSS that Te" microprSess^s) could execute instructions sufficiently fast to produce the requisrte data 

^ NnMevel flowchart of our inventive mutti-windowing thresholding method 200 is collectively depicted in FIGs. 2A 
and a tor ^hfc^Snec. a.ignment of the drawing sheets tor these figures is shown in FIG. 2. Dunng the course of 
and 2B. tor ^ntne c » F|Qs 3A . 3C M9 appropriate. 

MeZ S?2 peSo m^ S each and every gray-scale pixel in an incoming image, thereby Iterating ttrough ttje 
Method 20U is penui » processed is identical across all such pixels, we 

image. Since the fanner ^^^S^S^S^fS^ where i and j are positive integers and 
t£SZ£ ^S^SS^ the incoming grayscale image. In addition to grayscale image data. 

define pixel horizontal ana venioai cnerificallv lixed thresholds IT andGT. These thresholds are adjusted. 

8 T ^ beT e^hert - — *■ ^ *"£ 

^Sluch m cc^ rest and i.luminatton. or can be adjusted to provide optimum thresholding for any one type of 
acteristics. such as comras^ «• oertorming method 200 on all such gray-scale image pixels. 

a thresnolded ' sh'own in FIGs. 2A and 2B. if a modified grayscale image is to be produced, 

to a pixel m the | ,n ~™9 "^f 6 :*" pre-defined threshold, having a value tT. as that value 

TJE^tX^iZZ be further processed, e.g.. through scaling or filtering, as 

^partiCar. upon ~™ 

^In^l^oSob^ the Sobel °P erator relies on COmpUtin9 h ° r ' ,ZOntal ^ VertiCa ' ^ i0,enS,ty 9 
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GX(iJ) and GY(i.j), respectively, and for each pixel position (i.j) forming the gradient strength. G(i j) as an absolute sum 
ofGX(ij)andGY(ij): 

GX(i j) = L(i+1 + 2L(i+1 j) + L(i+1 • LO-1 • 2Ui-1 j) - L(i-1 (i) 
GY(ij) = L(i-1 + 2L(i.j+1) + L(i+1 J+1) - L(i-1 j-1) - 2L(i j-1) - L(i+1 j-1) (2) 

G(i j) = |GX(i j)| + |GY(i j)| (3) 

where: G(ij) is the gradient strength at pixel position 
(ij):and 

L(i j) | S the image intensity, luminance, at pixel 

position (i.j). .. . 

The resulting gradient strength value for every image pixel collectively forms a gradient strength record for the entire 

scanned image. 

Once the gradient strength. G(ij). is determined for pixel(ij). method 200 advances to step 206. This step, when 
performed determines the area gradient for pixel position (i,j), i.e., GS(i j), as the sum of the gradient strengths lor each 
and every pixel position within an (N-2)-by-(N-2) window centered about pixel position (i.j). This window is illustratively 
5-by-5 pixels in size and is shown, as window 370. in FIG. 3Cfor an N-by-N. illustratively 7-by-7, window shown in FIG. 
3B the latter being window 330. centered about pixel(i.j). For purposes of comparison, the periphery of ah N-by-N 
window is shown as window 350 in FIG. 3C. Though shown sequentially to simplify illustration, step 245 is generally 
performed at essentially the same time, as symbolized by dashed line 244 , as is steps 203 and 206. Step 244 determines 
both minimum and maximum pixel intensity values. L^ n and L^, respectively, in an N-by-N window centered about 

* I/" !\ 

Pl Once the area gradient is determined tor pixel position (i j). then, through the remainder of method 200. the three 
image measures. GS(i j) and ^ and U associated with this particular pixel position are used to classify pixel(i j) 
as an object pixel, i.e.. black, or a background pixel, i.e.. white. 

In particular, decision step 208 is performed to assess whether the value of the area gradient for pixel(i j). i.e.. GS(i.j). 
exceeds a pre-defined threshold value, GT. or not. This test determines whether pixel(ij) lies in a vicinity of an edge in 
the scanned image, or not. If the area gradient is less than the threshold value. GT. then pixel(i.j) does not lie near an 
edge Hence pixel(ij) lies within a localized relatively constant tone. i.e.. "flat" field, region of the scanned gr«y-i>uale 
image In this case, method 200 advances along NO path 21 1 emanating from decision block 208 to decision block 215. 
This latter decision block determines whether the gray-scale intensity of pixel(i.j), i.e.. I^, exceeds another pre-defined 
threshold value IT. If this gray-scale value is less than the threshold, the pixel is classified as an object pixel, i.e., here 
black- otherwise the pixel is classified as a background pixel, i.e.. here white. Specifically, on the one hand, if pixel 
intensity. is less than or equal to threshold IT, decision block 215 advances method 200. along NO path 217, to 
decision block 222. This latter decision block determines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. If a binary pixel is desired, then decision block 222 advances the method, via YES 
path 225 to block 228 which, in turn, sets an intensity of output pixel(i.j) to black, i.e.. zero. Alternatively, if a gray-scale 
output is desired, then decision block 222 advances method 200, via NO path 224, to block 230. This latter block, when 
performed sets the intensity of output pixel(i.j) to the intensity of Lc. without any modifications made thereto. If. on the 
other hand pixel intensity, Uc, exceeds threshold IT. decision block 215 advances method 200. along YES path 218, to 
decision block 232 This latter decision block determines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. If a binary pixel is desired, then decision block 232 advances the method, via YES 
path 235 to block 237 which, in turn, sets an intensity of output pixel(i.j) to white, i.e.. one. Alternatively, if a gray-scale 
output is desired, then decision block 232 advances method 200. via NO path 234, to block 241 . This latter block, when 
performed sets the intensity of output pixel(i.j) to the intensity of Lc, without any modif ications made thereto. Once step 
228, 237 or 241 is performed, method 200 is completed tor pixel(ij); the method is then repeated for the next image 

pix I in succession, and so forth. 

Alternatively if area gradient, GS(i j) exceeds the threshold value, GT. then pixel(i j) lies in the vicinity of an edge. 
In this case step 245 is now performed to ascertain the values of L^, and L^. if these values have not already been 
determined as set forth above. Thereafter, method 200 advances to block 248 which calculates an average pixel intensity 
value. ^ . occurring within the N-by-N pixel window centered about pixel position (i.j). This average intensity value is 
simply determined by averaging the values L^* and L^p. 

Once this average value has been ascertained, method 200 advances to decision block 251 which compares the 
intensity of pixel(ij). i.e., 1^. against "its associated average intensity value. L^g. When this pixel is situated on a darker 
side of an edge and hence an object pixel, then its associated average intensity value will be greater than or equal to 
its intensity value, Lc. In this case, the output binary pixel for pixel position (i.j) will be set to black. Otherwise, if pixel(ij) 
is situated near an edge but its average intensity value. L avg , would be less than its intensity value. Lc, then this pixel is 
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increase thresholding accuracy. oreaual to its associated average intensity value. 

,n particular. H gray-scale pixel «^orp^ ^S^iSwon block 260. This latter decision block 
L then decision block 251 advances method 200 along NO path 254 to aec s |f g 

^ermines whether a user has previous^ ££££ J^-JTSSS ai, t clock 268 which, in turn, 
binary pixel is desired, then ifa gray-scale output is desired, then decision block 260 

sets an intensity of output p.xel(.j) to black. ie.. zero. ib g y performed, determines whether 

, advances method ™*!*>^™*^SZ SS^^S-W) f "ess than or equal to threshold 
pixel intensity. "«^^^r^!Si?^J?^ 2TO which, when executed, sets the gray-scale output tor 
IT. then method 200 advances, along NO P^^ 2 ^^j2Xexceed6 the value of threshold IT. then method 
ffiCS^A aT^r 22S sets the grayscale ou*ut tor p^J) to a 

s valJthat is slightly less. I.e.. IT-, than ^shc^n. , value, L^g. then decision block 

Alternatively. N grayscale pixel .mens.ty ^ exc eds J^SSTS latter decision block'determines whether 
251 advances method 200. along YES path 253. to output pixel. H a binary pixel is desired, 

a user has previously instructed the JSSZ in turn, sets an intensity of output 

then decision block 280 ^^.^^^^^en decision block 280 advances method 200. 

. pixe.(i.j) to white. i.e.. one. However^ ^SSSbS wUn perforrned. determines whether pixel intensity. L,. is less 
via NO path 284. to dec,s.on block 290. Th« ; ' a «« ^ £™ exceed* or is equal to threshold IT. then method 200 
tnan pre-defined thresho. I value ™ ^^SK the grayscale output for pixe.f, j) to the pixel 

advances, along NO path 292. to btocKzaa tnresho | d | T then method 200 advances, along YES path 
intensity value U Now. if the .ntensrtyof p.xe K .fl ^ to a value that is slightly larger, i.e.. IT + . 

« 294. to block 297. which, when executed, sets pW™JJ ™* ^ respectively, threshold IT is not critical 
SJ^^rSTSOT^ 1SR « - been performed for pixe,(i * method 200 is 

then repeated for the ned ima 9 e £* e ^ depicts intensity profile 400 of an illustrative scan 

With this understanding in m.nd. conederF G , 0 shown in FIG. I.Asa resuH of processing 

30 line of an original grayscale -age. such '^^^^S^S%ni in FIG. 5. results. As is readily apparent 
profile 400 through our inventive method modrf .ec ' '^"V J^"* ^ xels locaXed nea r an edge are modHied. 

trom comparing profiles 400 and .^^^SSS^w X- ^ while its intensity is larger than threshold 
in this regard, when such a pixel is .located Im a darker ode o an eog Alternatively, when an image 

value IT. the intensity of this pixel * d ""*^^ threshold IT. the intensity of this pixel is 

" ima96 reSUKS ^ threSh ° ,din9 *" reSU ' tin9 

rnodiffed gray-scale image against fixed ^I^^l^^embodiment, specifically circuit 600. of our present invention. 

Fia6depictsab.ockd,agramof ^'^^^^^ £ FK3. 1 Clearly, image processor 30 would 
This Processing functions; however. a„ that circuitry 

As shown, circuit 600 is formed of hne de Iays61 0. specrt cany -line o y Mjn detector 635; 

gradient detector 615; sum of gradients ^^^M So^oTLrJ 664. and gates 662. 670 and 
averaging circuit 640; multiplexors 680 and 690 and 9a^c,rc^660 formea ^ jn detaj| ^ 

4, 675. Circuit 600 collectively implements method 200 dep cted "FWj £ and ^ ^ - 

, n operation, eight-bit input V^^^P^^^^^^ specfflcaly series-connected single 
,ine delays 610 and to an input of 7-by-7 Max and ^MetorMMq^ . P pjxel(i>D . 
line delay elements 610,. 610 2 and 610 3 . prov.de a J ne of ^ e window. The outputs of all three 

Each delay e.ement is tapped at three through ca,cu,ation 01 *« 8ob- 

50 delay elements are routed* respective J^^SSSTS to7pbce.(ij). i.e.. Gf.j). on output leads 617. This 
operator, as described above, provides an .nt ensrty grad ertt «»*P ^ ^ ne dient intensity ^ues 

gradient value is applied to an input to sum of J^f?^^tS^SS sum. as an area gradient value, i.e.. 
fn a S-by-5 window centered about p.xe pos-tion W^P™*** th „ ^ ^ area gradient va | ue 
GS(ij). on 12-bit output leads 622. C.rcu.t 620 » « istawn «HGL7 and dMWdno lhreshoW qj. 

* i S applied to an input ("A") °< '°^ ar ^ comparison output, appearing on 

the latter being applied to another input B ij?** ^J^Se or not. The comparison output is applied as an 
SrjZ^SK rl'^^X^ as discussed in detail below, the appropriate 

i k or one of the pre-defined values IT- or IT*. 
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Max and Min detector 635. depicted in FIG. 8 and discussed in detail below, ascertains the maximum and minimum 
pixel intensity values, i.e.. L max and of those pixels contained within a 7-by-7 window centered about! pixel(l.fl. 
Resulting L and L min values, appearing on leads 637 and 639, are then averaged by averaging circuit 640. This circuit 
contains summer 642. which merely adds these two values together into a resultant sum. and 12 and delay circuit 646 
which irrplements a divide by two operation by shifting the sum one-bit to the right; hence dropping the least significant 
bit The resultant averaged intensity value is then appropriately delayed within circuit 646 tor purposes of achieving 
proper synchronization within circuit 600. 

If the area gradient value. GS(ij), exceeds the pre-defined gradient threshold. GT. then the averaged intensity value, 
L used as a threshold level in determining the value of output center pixel(ij); else, if the area gradient value is less 
than or equal to the gradient threshold, then value IT is used as the threshold level in determining the value of output 
center pixelfi j) In this regard, the averaged intensity value. L 8vg , is applied to one input of comparator 650. The current 
center pixel value. Lc. is applied through delay element 630 to another input of comparator 650 as well as to one input 
of comparator 655. The delay of element 630 is set to assure that the proper corresponding values of 1^ and Le Vg are 
synchronously applied to collectively comparators 650 and 655. multiplexors 680 and 690. and gating circuit 660. The 
fixed threshold value. IT. is applied to another input of comparator 655. Comparator 650 produces a low or high or low 
level output on lead 653 if pixel intensity value 1^ is less than, or equal to or greater than, respectively, its associated 
averaged intensity value. Le V g- ™s output level is applied to both one input fl") of multiplexor 680 and one input of 
AND gate 662 Multiplexor 680 selects the output binary pixel as between two bits generated from using two different 
thresholds i e value IT or L avg . In that regard, comparator 655 produces a high output level at its A>B output whenever 
the predefined' threshold value IT is greater than pixel intensity value L,.. The level at output A>B is routed, via leads 
657 to another input ("0") of multiplexor 680 and to one input of AND gate 670. Multiplexor 680 produces the output 
binary value for pixel(i.j). To do so, the comparison output level produced by comparator 625. indicative of whether the 
area gradient GS(i.j), exceeds the gradient threshold. GT is applied as a select signal, via lead 628, to a select fS") 
input of multiplexor 680. If this select signal is high, thereby indicating that the area gradient exceeds the gradient thresh- 
old then multiplexor 680 routes the level applied to its "1 * input, i.e.. that generated by comparator 650. to binary output 
lead 33' else the multiplexor routes the level then appearing at its "0" input to lead 33. 

Multiplexor 690 routes the center pixel value. or a pre-defined value IT+ or IT- as the output gray-scale value to 
eight-bit output leads 37. Pre-defined values IT+ and IT- along with center pixel value Uc are applied to different corre- 
sDondino eight-bit inputs to multiplexor 690. The output of this multiplexor is determined by the state of two select signals, 
SO and SI • if these signals assume the binary values rero. "1" or "3", then the multiplexor will route center pixel value 
U value IT+ or value IT-, respectively, to output leads 37. Gating circuit 660, in response to the comparison output 
sionals produced by comparators 625. 650 and 655 generates, by simple combinatorial logic, the two select signals, SO 
and S1 applied to multiplexor 690. Specifically, if the area gradient is not larger than the gradient threshold, then, as 
discussed above gray-scale pxel value l^. without any modification, will be applied through multiplexor 690, to output 
leads 37 Alternatively, if the area gradient exceeds the gradient threshold, then multiplexor 690 will apply ether value 
IT+ or IT- as a modified gray-scale output value to lead 37 based upon whether center pixel intensity value is less 
than its corresponding average pixel intensity value. L avg . or not. Since the operation of gating circuit 660 is self-evfclent 
from the above description to anyone skilled in the art, it will not be discussed in any further detail. Values IT- and IT+ 
are merely held in appropriate registers (not shown) and from there applied to corresponding inputs of multiplexor 690. 

FIG 7 depicts a block diagram of Sum of Gradients Circuit 620 which forms part of circuit 600 shown in FIG. 6. 
Circuit 620 as shown in FIG. 7, is formed of adder 710 and line delays 720, the latter containing four series-connected 
single-line delay elements 720 0 , 720 n , 720 2 and 720 3 . Incoming gradient intensity values are applied, over lead 617 
from gradient detection circuit 615 (shown in FIG. 6), to one input of adder 710, shown in FIG. 7. In addition, the output 
of each of the four line delays 720 is routed over a different one of four feedback leads 715 to a different corresponding 
input of this adder. As a result adder 710 forms partial sums of 1-by-5 gradient values which are applied, as input, to 
delay element 720 0 To generate a 5-by-5 sum of the intensity gradients, hence producing an area gradient measure, 
four preceding conesponding 1 -by-5 sums are added together within adder 710 to a present 1 -by-5 sum, with the result- 
ant overall 5-by-5 sum being applied to output lead 622. Use of these delay elements connected in this fashion substan- 
tially reduces the amount of logic that would otherwise be needed to generate twenty-five intermediate sums. 

FIG 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG 6 As noted above, detector 635 determines the maximum and minimum pixel intensity values. L^* and 
, respectively within a 7-by-7 window centered about pixel posrtionfi.D. This detector is formed of two separate 
circuits rmaximum detecting circuit 805 and minimum detecting circuit 840 which extract a pixel value having a maximum 
and minimum intensity value, respectively, of all the pixels contained within the 7-by-7 window centered around pixelfij) 
and respectively apply those two values to leads 637 and 639. Circuit 805 contains maximum detector 810 and line 
delays 820 the latter being formed of six series-connected single-line delay elements 820 0 . 820i. 820 2 . 820 3 , 820 4 and 
820 5 Similarly circuit 840 contains minimum detector 850 and line delays 860. the latter being formed of six series- 
connected single-line delay elements 860 0 . 860^8602, 860 3 . 860 4 and 860 5 . Inasmuch as circuits 805 and 840 function 
is an identical manner with the exception that detector 81 0 locates maximum values while detector 850 locates a minimum 
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values both from the same series of pixel intensity values applied over lead 608. we will only discuss court 805 .n detail . 
£Z skSed nThe art will then readily appreciate how circuit 840 functions from th,s d IS cuss.on. 

fnool^g Pixel intensity values are applied, over lead 608 to one input of maximum detector 810Jn addition , the 
- i X tZ . six line delays 820 is routed over a different one of six feedback leads to a respective input of this 
?SLf ^^^STclSSi 810 extracts the maximum pixel intensity value from a 1-by-7 series of pixel 
va 6 ueTarS S« 2 maximum value as input to line delay element 820 5 . In conjunction with six preceding corte- 
values and * ^ ; |jn del 820 max i mum detector 810 locates the maximum pixel intensity 

se^on^ected detey elements 820 and 860 substantially reduces the amount of logic that would otheiw.se be needed 
«««r^« iniorm^riiaiG maximum and minimum pixel intensity values. 
9 /Cf one can n^aP^ate. the quality of the resulting thresholded image produced by our invention is controlled 
hv lvalues SLsho ds GT and IT. Threshold GT is set to properly classify image pixels located in the v,anrty 

^So« n an inSe A r elatively low GT value tends to extract edge pixels of light objects. Threshold IT is set to property 
nixSs Sedin!mage regions of uniform tone. i.e.. Hal" fields. In that regard, a low IT value tends to classify 
Sf a ^ unHon?g^y regtonas while background. If a relatively high GT value is used, then our invention for a., prachca. 
P oeiorms sim lar to "simple- thresholding with a fixed threshold IT. In this situation, the value erf threshold GT 

wi. Xfys^rger than the areTgradient. thereby causing our invention to classify pixels by essentially so.e* com- 
? T^himaoe pixel of interest against fixed threshold IT. Our invention can also produce an outline image through 
Z TJSi rnrthCd IT to zem. in which case all the image pixels will be classified as white except for the edge 

• i K«r^ thoir undated area Gradients are larger than the gradient threshold, GT. 
PW Ih^uah one p^S ealmtSfment of the present invention has been shown and described in detail herein many 
oth TUX* elXents that incorporate the teachings of the invention may be easily constructed by those skilled ,n 

the art 

mm IRTRIAI A PPI ir.ARILITV AMn ADVANTAGI 

The present invention is useful in image scanning systems and particularly for thresholding scanned °ray-scale 
imao^ conTaNngTne art The invention advantageously provides more accurate thresholding than that Piously 
obSSbleTn The art by exhibiting enhanced immunity to background noise in the scanned image and substantially 
eliminating boundary artifacts from a thresholded image. 

Claims 

1 A method for thresholding an input gray-scale image into a first output imag* wherein said mptf image is formed 
' « ^ aich having a multi-bit grayscale pixel value associated therewith, and wherein saidf irst output image 
SUtSi SSIE?. corresponding output pixel value associated therewith, characterized in that the 

^^aSeSw in re^nle to a plurality of pixel values in the input image, an area gradient value for a f iret 
window Slut of^efinS size, of intensity gradient values associated with ones of the pixel values centered 
=h«.rt a «irrcnt Dixel position. (i.j) (where i and j are pixel indices), in the input image, 

^^In^poJe » a second window (330). of pre-defined size, of input pixels centered about the 
currem P td7srt?on" i.j) irTthe input image, a maximum pixe. value and a minimum pixel value of the pixel values 

r^nfainpH within said second window; and B . 

thrSSnT in re^onse to the area gradient value and the maximum and minimum pixel values, a current one of 
I^efSues foMhe current pixe. position (i.j) in the input image into an output pixel value at a corresponding 
position in the first output image. 

* thd m pthnd of claim 1 wherein the area gradient ascertaining step comprises the steps of: 

2. The meth« Id*. ^ 9 ^ ^ ^ pjxe| ^ Qf . preKjefined size and centered about 

the cur^nt SXsition (i.j) in the input image, an intensity gradient. Gf. j). value for the current pocel^ position such 
Zt for " ?SZ*E** * input pixels in the input image, a pluralrty of corresponding intensrty grad.ent values « 

^'"^ofming the first window of intensity gradient values from the plurality of intensity gradient values and. in 
response to said first window, determining said area gradient value. 

, Tho method in claim 2 wherein said first window forming and area gradient determining step comprises the step of 
nZZ^ZTones of the intensity gradient values in said first window to produce the area gradient value. 
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4 The method in claim 3 wherein said thresholding step comprises the steps of: 

comparing the area gradient value. GS(i j). to a pre-defined gradient threshold value. GT. so as to produce 
a comparison signal indicative of whether a current one input pixel located at the current pixel position (ij) in the 
input image lies in a vicinity of an edge in said input image; 

if the comparison signal indicates that said current one input pixel does not lie in the vicinity of the edge, 
thresholding in response to said comparison signal, said input pixel value at position (ij) in the input image against 
a pre-defined fixed gray-scale threshold value. IT. to yield a corresponding binary output value at pixel position (i j) 

in the first output image; and 

if the comparison signal indicates that said one current input pixel does lie within the vicinity of an edge, 
setting in response to said comparison signal, said corresponding binary output value to a first or second state if 
the current one pixel value either exceeds or is less than an average of the maximum and minimum pixel values, 
respectively. 

The method in claims 3 or 4 wherein said intensity gradient measuring step comprises the step of producing the 
intensity gradient value for the current pixel position by processing said third window of input pixel values through 
a Sobel operator. 

The method in claim 5 wherein the third window is a 3-by-3 window of input pixel values and the Sobel operator 
implements the following equations: 

GX(ij) = Lfi+1 j-1) + 2L(k1 j) + L(i+1 j+1) - L(i-1 - 2L(M j) - L(i-1 j+1); 
GY(i,j) - L(M + 2L(ij+1) + L(t+1 j+1) - L(i-1 j-1) - 2L(ij-1) - L(i+1.j-1); 



5. 



6. 



and 



G(i j) = |GX(i j)| + |GY(ij)| 



where: L(i.j) is an input pixel value, in luminance, for 
the pixel position (i j) in the input image. 

7 The method in claim 4 further comprising the steps of: 

producing, in response to said comparison signal and the pixel value (Uc) at the current pixel position (i j). a 
modified gray-scale output pixel value at position (ij) in a second output image, wherein, if the comparison signal 
indicates that the one current input pixel does not lie in the vicinity of the edge in said input image, the modified 
orav scale output pixel value is set equal to the pixel value Lc, or if the comparison signal indicates that the current 
one input pixel does lie in the vicinity of the edge, the modified gray-scale output pixel value is set equal to a pre- 
defined value greater than or less than the threshold value IT when the pixel value Lc is greater or less than, respec- 
tively the threshold value IT; and 

thresholding the modified gray-scale output pixel value, againstthe threshold value IT. to yield a corresponding 
second binary output pixel value at a pixel position (ij) within a second output image. 

8 ADoaratus for thresholding an input gray-scale image into a first output image, wherein said input image is formed 
" ofinput pixels each having a multi-bit gray-scale pixel value associated therewith, and wherein said first output image 

is formed of pixels each having a corresponding output pixel value associated therewith, characterized in that the 
apparatus utilizes the steps recited in any of claims 1 -7. 
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(54) A multi-windowing technique for threshholding an image using local image properties 



(57) A technique, specifically apparatus and an 
accompanying method, for accurately thresholding an 
image based on local image properties, specifically lumi- 
nance variations, and particularly such a technique that 
uses multi-windowing for providing enhanced immunity 
to image noise and lessened boundary artifacts. Specif- 
ically a localized intensity gradient. G(i j). is determined 
for a pre-defined window (300) centered about each 
image pixel(ij). Localized minimum and maximum pixel 
intensity measures. L™ and L^,. respectively, are also 
determined for another, though larger, window (330) cen- 
tered about pixel(ij). Also, a localized area gradient 
measure. GS(i j). is determined as a sum of individual 
intensity gradients for a matrix of pixel positions (370) 
centered about pixel position (i.j). Each image pixel(ij) is 
then classified as being an object pixel, i.e.. black, or a 
background pixel, i.e.. white, based upon its area gradi- 
ent, GS(ij), and associated l™ and L^x measures. 
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